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In the context of the standard model with a fourth generation, we explore the allowed mass 
spectra in the fourth-generation quark and lepton sectors as functions of the Higgs mass. Using the 
constraints from unitarity and oblique parameters, we show that a heavy Higgs allows large mass 
splittings in these sectors, opening up new decay channels involving W emission. Assuming that 
the hints for a light Higgs do not yet constitute an evidence, we work in a scenario where a heavy 
Higgs is viable. A Higgs heavier than ~ 800 GeV would in fact necessitate either a heavy quark 
decay channel t' — >■ b'W/b' t'W or & heavy lepton decay channel t' ^ v'W as long as the mixing 
between the third and fourth generations is small. This mixing tends to suppress the mass splittings 
and hence the W^-emission channels. The possibility of the M^-emission channel could substantially 
change the search strategies of fourth-generation fermions at the LHC and impact the currently 
reported mass limits. 
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I. INTRODUCTION 

The number of fermion generations in the standard 
model (SM) is three, though there is no fundamental 
principle restricting it to this number. The data on Z 
decay only puts a lower bound of mz/2 on their masses 
[T]. Direct searches at the Tevatron [BE] and the LHC 
[7lfT4] further put lower bounds on the masses of fourth- 
generation charged fermions, by virtue of them not hav- 
ing been observed at these colliders. These limits are 
subject to certain assumptions about the decay channels 
for these quarks. The most conservative, almost model- 
independent limits for fourth-generation quarks are given 
in [TS] . Indirect limits on the masses and mixing of these 
fermions are also obtained through the measurements 
of the oblique parameters T, U [TB] . Theoretical con- 
straints like the perturbativity of the Yukawa couplings 
and the perturbative unitarity of heavy fermion scatter- 
ing amplitudes |17j bound the masses from above. In 
spite of the rather strong bounds from all the above di- 
rections, there is still parameter space available for the 
fourth generation that is consistent with all the data [T51 - 
[29] . The fourth-generation scenario (SM4) is thus still 
viable even after the recent Tevatron and LHC results 

[301 in]- 

The discovery of a fourth-generation of fermions 
will have profound phenomenological consequences |32j . 
Some of the experimental observations that deviate some- 
what from the SM expectations - like the CP-violating 
phases in the neutral B mixing |33H36j - could be in- 



*Electronic address: amol® t heory. t if r . res . inj 

^Electronic address: diptimoyghosh@theory.tlfr. res. in 

tElectronic address: rohini@cts.iisc.ernet.in 

^Electronic address: arunprasath@cts.iisc.ernet.in 



terpreted as radiative effects by the fourth-generation 
fermions. The implications of a fourth family for ob- 
servables in charmed decays |37| and lepton-flavor violat- 
ing decays j38j as well as flavor constraints on the quark 
sector|3nj have also been discussed. 

The Cabibbo-Kobayashi-Maskawa (CKM) structure of 
4 generations, with 3 observable phases and large Yukawa 
couplings, may also provide enough source of CP viola- 
tion for the matter-antimatter asymmetry of the Uni- 
verse, although the issue of the order of the electroweak 
phase transition still has to be resolved [IDj. The exis- 
tence of a fourth-generation is also intimately connected 
with the Higgs physics. The Higgs in the SM4 with a 
mass of about 800 GeV is consistent with precision elec- 
troweak (EW)data when mt',mb' ~ 500 GeV, with the 
mixing between third and fourth-generation quarks of the 
order of 0.1 [55]. This raises an interesting possibility 
of Higgs being a composite scalar of fourth-generation 
quarks |41H43) with interesting phenomenological im- 
plications including an enhancement of flavor-changing 
as well as flavor-diagonal Higgs decays into third and 
fourth-generation fermions. Implications of a strongly 
interacting fourth-generation quark sector on LHC Higgs 
searches has been discussed in [44]. Phenomenology of 
the lepton sector of the SM4 has been studied in [iSHlH] . 

The Higgs production cross section at hadron collid- 
ers is affected strongly by the fourth-generation through 
the gg ^ h channel due to the heavy masses of the new 
fermions [1M5^ . The branching ratios of Higgs into dif- 
ferent channels are affected too [JSl liH [S3] . As a con- 
sequence, the direct search limits on the Higgs mass are 
stronger in the presence of the fourth-generation. Higgs 
production and decay cross sections in the context of four 
generations, with next-to-leading order EW and QCD 
corrections, have been calculated in 50- 52J. The produc- 
tion cross section is enhanced for a light Higgs (m/j < 200 
GeV) by an order of magnitude. However the enhance- 
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ment may be somewhat reduced for a heavier Higgs [53] ■ 
The ATLAS experiment at the LHC has excluded the 
Higgs boson of SM4 with a mass between 119 GeV and 
593 GeV [SSJ, while the CMS exclusion limits are from 
120 GeV to 600 GeV j56j. These experiments include the 
one loop EW corrections to Higgs production from the 
fourth-generation fermions^. 

Recently, experiments at the Tevatron and the LHC 
have reported an excess of events around mh ~ 125 GeV 
with a local significance of about 2a — 3a in the search for 
the standard model Higgs boson [53HBS]. Reference [BB] 
interprets these "hints" for a light Higgs in the framework 
of SM4. We on the otherhand, assume that these hints 
do not yet constitute an evidence and may well be a 
statistical fluctuation. Under this assumption, a heavy 
Higgs with mass > 600 GeV is a viable scenario. 

Recent explorations of possible effects of a fourth- 
generation on the Higgs mass, precision observables, 
quark mixing matrix, and flavor-changing neutral current 
phenomena have yielded interesting results. It has been 
pointed out [57] that the existence of a fourth generation 
allows for a heavier Higgs to be consistent with the pre- 
cision measurements. The constraints on the mixing be- 
tween the third and fourth generation have been obtained 
from the precision EW data [5S], and a fit to the flavor- 
physics data [BS] . The latter shows that, while the mixing 
of the fourth-generation quarks to the three SM genera- 
tions is consistent with zero and restricted to be small, 
observable effects on K and B decays are still possible. 
Large masses of the fourth-generation fermions lead to 
nonperturbativity of Yukawa couplings at a low scale 
A ^ MauT as well as instability of the vacuum. This has 
been investigated in the context of models without super- 
symmetry (SUSY) [m [13 iMl] and with SUSY [73], 
after taking into account various bounds from precision 
EW data as well as collider and direct search experiments 
on sequential heavy fermions. 

In this article, we revisit the electroweak precision 
constraints from the oblique parameters 5, T, U on the 
fourth-generation, taking into account the mixing with 
the third generation. We perform a analysis, varying 
the fourth-generation quark as well as lepton masses in 
their experimentally allowed ranges, and obtain a quan- 
titative measure for the fourth-generation fermion mass 
spectrum preferred by the measurements of these param- 
eters. In the light of the heavy Higgs preferred by the 
LHC data, we focus on the implications of a heavy Higgs 
for the mass spectrum. Wc also study the effect of the 
mixing between third and fourth-generation on this mass 
spectrum, and try to understand these effects analyti- 
cally. As we will see later, the correlation between the 
mass splittings in quark and lepton sectors is strongly 
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of the scalar sector 1571 or by having Higgs decay to stable invis- 
ible particles which could be candidates for dark matter [58l462) . 
However this is not the minimal SM4 we focus on in this paper. 



influenced by this mixing angle. 

The paper is organized as follows. In Sec. jlT] we dis- 
cuss the bounds on the fourth-generation fermion masses 
from direct searches and the theoretical requirement of 
perturbative unitarity. We also analyze the structure of 
constraints f rom the measurements of oblique parame- 
ters. In Sec. HI we perform a x^-fit to the oblique pa- 
rameters and obtain constraints on the mass splittings in 
the quark and lepton sectors, focusing on a heavy Higgs. 
Sec. |IV| discusses the collider implications, while Sec. |V] 
summarizes our results. 



II. CONSTRAINTS ON THE 
FOURTH-GENERATION FERMION MASSES 

A. Lower bounds on masses from direct searches 

The direct search constraints presented by CDF [21 [3] 
on the masses of t' and h' quarks have been gener- 
alized to more general cases of quark mixing by [15j . 
and a lower bound mt',m{,' > 290 GeV has been ob- 
tained. The currently quoted exclusion bounds by CDF, 
D0, CMS and ATLAS collaborations [3 [BHini HI E] 
are 400-500 GeV, however as stated earlier, they are 
based on specific assumptions on branching ratios of the 
fourth-generation quarks and mass differences between 
the fourth-generation fermions. 

The limits on the masses of heavy charged fermions are 
obtained from the nonobservation of their expected de- 
cay modes. The choice of analyzed decay modes affects 
the bounds to a large extent. Since we would like our 
results to be independent of assumptions about the mix- 
ing angles, mass differences, and hence branching ratios, 
in our analysis we shall use the bounds from [TSl for the 
quark masses. For the fourth-generation leptons r' and 
v' , we take the bounds rrir' > 101.0 GeV and niy^ > 45.0 
GeV [T] . The mixing of the fourth-generation leptons is 
restricted to be very small, so it would not affect our 
analysis. 



B. Upper bounds on masses from unitarity 

The direct search constraints imply that the fourth- 
generation quarks are necessarily heavy {mp 3> 
MwtMz)- For such heavy fermions F, the tree- 
level amplitudes of certain processes like FF — ?> 
FF, WW, ZZ, ZH, HH, in a spontaneously broken 
SU{2)l X U{1)y gauge theory, tend to a constant value 
Gprn^ at center-of-mass energies s ^ m?p. For large 
value of mp, the term GpTnjp can be 0(1). In that case, 
the tree-level unitarity of the S-matrix is saturated and 
in order to regain a unitary S-matrix, higher order ampli- 
tudes need to contribute significantly. This necessitates 
a strong coupling of these fermions to the gauge bosons, 
which makes the perturbation theory unreliable. This 
was first studied in the context of the SM with ultraheavy 
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fermions in [T71 [73]. The corresponding analysis in the 
context of the minimal supersymmetric standard model 
with a sequential fourth generation was performed in [75] , 
in the limit of vanishing mixing between the fourth gen- 
eration quarks and the first three generations. 

We reevaluate the bounds given in [74 , considering the 
J = partial-wave channel of the tree-level amplitudes 
of the color-neutral and charge-neutral processes FiFi — 
FjFj. In [73] only the amplitudes involving two heavy 
fermions of a SU{2) l doublet were analyzed. The second 
SU{2)]^ doublet of heavy fermions only provided a source 
for mixing included in the analysis. However, we include 
all the relevant channels involving all the heavy quarks 
-t' , b' and t, and take into account mixing between the 
third and fourth-generations. The lowest critical value 
of the fermion mass is obtained by equating the largest 
eigenvalue of this submatrix to unity. Expressions for the 
partial-wave matrices are given in the Appendix. The 
results are shown in Fig. [Tjfor sin034 = 0.0, 0.3. One can 
easily observe from the figure an improvement of about 
6% in the bounds compared to those in [T^ . The bounds 
are affected due to the inclusion of the top quark in the 
analysis, which introduces more scattering channels. It 
may be seen from Fig. |l] that the bounds are not very 
sensitive to the actual value of the mixing. 

In the lepton sector, only fourth-generation leptons 
(t' and Vr') are relevant for the perturbative unitar- 
ity constraints as all the first three generation fermions 
are light compared to Mw- The mixing between the 
fourth-generation leptons and the first three generations 
is constrained by experimental bounds on lepton- flavor 
violating processes [3H1 |73 [77]. The 2a lower bound 
on the (4,4) element of the Pontecarvo-Maki-Nakagawa- 
Sakata matrix in SM4, Ut'u', is very close to unity: 
\Ur'u'\ > 0.9934 [75]. Moreover, we do not have any 
heavy fermion in the first three generations in contrast 
to the quark sector which has the top quark. Therefore, 
we do not have any new channel in addition to those 
that are considered in [73]. Hence we do not expect any 
improvement over the bounds given in [74] in the case of 
leptons. 



C. Constraints from oblique parameters 

The oblique parameters S, T, U [75] are sensitive 
probes of the fourth-generation masses and mixing pat- 
tern. The definitions of S, T, U parameters are given by 



S 
T 
U 



16^[H^3(0) 
47r 



1 



)m| 



[nii(0)-n33(0)] 



16^[H'n(0)-H'33(0)], 



(1) 
(2) 
(3) 



where — sin^ 9w ^ and ^{q^) are the vacuum polariza- 
tion H-functions. The suffixes 1, 2, 3 refer to the gener- 
ators of SU{2)i^, and the suffix Q to that of the electro- 
magnetic current. The contribution to these parameters 
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FIG. 1: The perturbative unitarity bounds on 
(mf , JTib' ) are shown above as dashed-lines for 
sin 6*34 = 0.0 (green/light) and 0.3 (blue/dark). The 
solid lines are obtained from the analytical expression 
for the unitarity bound given in [73] by substituting the 
respective values of sin 634. The corresponding bounds 
on the fourth-generation lepton masses are 7x1^.1 ,^1 < 1.2 
TeV [74 . 



from a fermion doublet (w, d) is 
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Here Nc is the number of colors 
of the fermions [Nc = 3 for quarks and Nc = 1 for 
leptons), and Y is the hypercharge of the fermion doublet. 
Note that when the quarks in the doublet are almost 
degenerate, i.e. A = |to„ — rn^l <C rriu, md, 



T{xu,Xd) 



1 



(7) 



These expressions can be readily generalized to the case 
of additional sequential generations. 

Following Gfitter [TB], we fix the masses of the top 
quark and the Higgs boson at their reference values of 
fht = 173.1 GeV and rhh = 120 GeV. With these masses, 
in the SM we have S" = 0, T = and C/ 0. The devi- 
ation from these values are denoted by AS", AT, AU re- 
spectively. The effect of the Higgs mass appears through 
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the dependence 
AUh 



1 , f mh 



log 
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(9) 
(10) 



The contribution from the fourth-generation of 
fermions to these parameters, after taking into ac- 
count the mixing between third and fourth-generation 
of quarks, can be expressed as 



We present our results in terms of the goodness-of-fit 
contours for the joint estimates of two parameters at a 
time, where the other four parameters are chosen to get 
the minimum of x^- For the purposes of this investiga- 
tion, we show contours of p — 0.0455, which correspond 
to = 6.18, or a confidence level(C.L) of 95%. 



III. CONSTRAINTS ON THE MASS 
SPLITTINGS Ao AND Af 



AS4 -- 
ATi = 

AC/4 = 
where 



(11) 



S {Xt' , Xi)i ) + S{x^' , Xt' ) , 

-sl^T{xt,xi,) + slj'{xt',X},) + sl^T{xt,Xb') + 



^34 



T{xt',Xb') +T{Xi,>,Xr') , (12) 
-sl4^U{xt,Xb) + sl^U{xt',Xb) + sliU{xt,Xb') + 



We now focus on the constraints on the mass sphttings 
Aq and Ag. We scan over the allowed values of the other 
parameters, and take only those parameter sets that are 
consistent with all the data currently available. 



Constraints on Ao 



C^4U(xt',Xb') + U{Xi,',Xr') 



(13) 
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cos2 ^34 and 034 is the mix- ^^e top left panel of Fig. § we show the 95% C.L 



ing angle between the third and the fourth-generation 
quarks. Note that here we neglect the mixing of the 
fourth-generation quarks with the first two generations, 
since the bounds on this mixing are rather strong |68j . 
We also neglect any mixing of the fourth leptonic gener- 
ation. We work in an approximation in which we neglect 
the nonoblique corrections to precision EW observables. 
This allows us to use the S, T, U values provided by fits 
to the precision EW observables, for example the ones 
provided by the Gfitter group [TB] . 

When the mixing of the fourth and third generation 
quarks is nonzero, the decay width for Z ^ bb receives 
contribution from fourth-generation quarks through ver- 
tex corrections, in addition to the oblique corrections. 
To study the effect of fourth generation fermions on 
the precision EW observables in general mixing scenar- 
ios, one should, in principle include both the vertex and 
the oblique corrections to precision EW observables [75] . 
However, as mentioned above , in order to use the Gfit- 
ter results on S, T, U which were obtained in the limit of 
vanishing mixing ,we use only the values of the mixing 
angles that are consistent with the Z — >■ 56 constraints 

m- 

In our analysis, we evaluate the S, T, U parameters nu- 
merically using FeynCalc [HU] and LoopTools [81j. Then 
we take the experimentally measured values of these pa- 
rameters 1 16,1 and perform a x^-fit to six parameters: the 
four combinations of masses 



contours in the nih - Aq plane marginalizing over other 
new-physics (NP) parameters (m,, to;, A^, ^34). From 
this panel, it is observed that at large nih values, the 
value of \Aq\ can exceed M^y. 

We now explore the effect of lepton mass splitting (A^ ) 
and the fourth- generation quark mixing (^34) in more de- 
tail. The bottom left panel shows the effect of restricting 
jA^I to Mw, while the top right panel shows the effect of 
vanishing 6*34. It is observed that there is no significant 
change in the allowed parameter space. 

However, when both the conditions of vanishing ^34 
and \Ag\ < Mw are imposed, the character of the con- 
straints changes dramatically, as can be seen from the 
bottom right panel. In this case, not only is \Aq\ > Mw 
allowed at large rrih, one has to have \Aq\ > Mw for 
"^/i }^ 800 GeV. At such large ruh values, then, either 
lA^I > mw or |Ag| > mw- At least one of the decays 



via W emission (f -J> b'W, b' t'W, r' 



W and 



mq = {m,t' + mf,/)/2 
m£ = (mj,' + m^')/2 



A, = 



my 



TO,,' — Tot 



the Higgs mass m^, and the mixing svnO-^^. We take the 
ranges of mq and m^ to be those allowed by the uni- 
tarity constraints and the direct search bounds stated 
above. For the other parameters, we take |Ag| < 200 
GeV, |A^| < 200 GeV, 100 GeV < mu < 800 GeV, 
I sin034| < 0.3, unless explicitly specified otherwise. 



v' t'W) then must take place. 

In most analyses of a fourth-generation scenario with 
a single higgs doublet, \Aq\ had been assumed to be < 75 
GeV due to the need to satisfy precision EW constraints. 
As seen above, the LHG exclusion of Higgs masses upto 
TO/i ^ 600 GeV in fact allows larger mass differences in 
the fourth-generation quark doublet. Since \Aq\ > Mw 
is allowed, the channel t' — b'W , or b' — > t'W becomes 
allowed. This condition will have strong implications for 
the direct searches of the fourth generation scenario. 

The correlation between Aq and Ag observed above 
may be understood analytically as follows. First, note 
that the functions T{xu,Xd) in Eq. ^ are positive 
semidefinite [78] . The only negative contribution to AT4 
of fermions is then from the first term of Eq. (12 1, how- 



ever it is compensated by the next term which is larger in 
magnitude and positive. [In particular, when Xf ^ Xb, 
the first two terms in AT4 add up to a positive quan- 
tity: 3s§4(a;t/ — Xt)/{lQns1yc'^).] Thus, the contribu- 
tion from fermions to AT4 is positive for all values of 
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FIG. 2: The 95% C.L. allowed regions in the ruh - A, plane. In the top two panels, Ag is varied over |A^| < 200 
GeV, while in the bottom two panels Ag is restricted to be less than Mw- In the left two panels, 634 is varied over 
sin034 < 0.3, while in the right two panels, 634 has been fixed to zero (no mixing). The parameters rriq and m; are 
varied over their complete allowed range. The grey shaded region is excluded at 95% by the LHC data. The dashed 



blue lines correspond to |A„ 



fermion masses. On the other hand, Eq. Q shows 
that the contribution from Higgs to AT is negative for 
TO/i > rhh = 120 GeV. In order to be consistent with 
precision electroweak data, the negative contribution to 
ATh from Higgs should be compensated adequately by 
the positive contribution AT4 from fermions. (Although 
we also have S, U parameters, the effect on T dominates 
the behavior of our results.) This contribution comes 
from a combination of T(a;„, Xd) in the quark and lepton 
sectors, leading to a strong correlation between the quark 
and lepton mass splittings. 

When 634 is zero or extremely small, the only contribu- 
tions to AT4 are from T{xt' , xi,i) and T{x^> , Xt')- These 
quantities then have to be sufficiently large to compen- 
sate for the large ATh appearing at large mh, necessi- 
tating a large mass splitting either in quark or in lepton 
sector. As the Higgs mass increases, the compensating 
contribution AT4, and hence the required mass splittings, 
also increase, exceeding Mw for nih > 800 GeV. On the 



other hand, when 634 is near its maximum allowed value 
of sin 6*34 = 0.3, the first three terms in AT4 also con- 
tribute, as a result of which the mass splitting in fourth- 
generation quarks is restricted and cannot exceed Mw- 

Based on the above discussion, the features of Fig. [2] 
can be easily understood. The insensitivity of the allowed 
values of \Aq\ to | sin 634! in the top panels is mainly due 
to the fact that the lepton mass-splitting |Af| is varied 
over a sufficiently large range. This ensures that the con- 
tribution of Higgs to AT is compensated by the contribu- 
tion from fermions even in the absence of an enhancement 
of quark contribution by a nonzero value of sin ^34 . Now 
in the bottom- right panel, jA^j is restricted to be less 
than along with sin 6*34 = 0. Here the absence of an 
enhanced quark contribution to AT4 due to sm.034 — 0, 
as well as insufficient contribution from leptons to AT4 
due to the restriction on lA^j, lead to the exclusion of 
|Ag| < M\Y at large m/j. In the bottom-left panel the 
excluded regions \Aq\ < Mw become allowed as the con- 
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tribution from the quarks to AT4 is enhanced by sin034. 

Note that earher works [251 ES El] that had predicted 
the mass spHtting in the quark sector to be less than 
M\Y had focused on a hght Higgs. That a hghter Higgs 
would only allow a small splitting should be clear from 
our figures and analytical arguments. 



B. Constraints on Ai 

In the top-left panel of Fig. [sj we show the 95% C.L. 
contours in the to/j - plane, marginalizing over other 
NP parameters (mg, to/, A^, ^34). It is observed that while 
at low TO/i values Ag can take any sign, at large to/j values 
it is necessarily negative, i.e. m^' > m^'. Moreover, |A^| 
can take values as large as 180 GeV. 

The effect of setting sin 6*34 = on the allowed values 
of jA^I is not significant, as can be seen in the top- right 
panel. If \Aq\ is restricted to be less than M^r, while 
allowing any mixing sin034 < 0.3, the parameter space is 
again not affected much as the bottom left panel shows. 
However, if |Ag| is restricted to be less than Mw, along 
with setting sin 6^4 = as shown in the bottom- right 
panel, |A^| is required to be large in magnitude. For 
ruh > 800 GeV, |Af| > Mw and the decay t' ^ i/'W is 
bound to occur. The features of the four panels regarding 
the role of sin034 and \Aq\ can be understood by the 
arguments given in the previous section. 

The negative sign of A^ may be understood as follows. 
The Higgs contribution ASh to the S parameter is al- 
ways positive, as can be seen from Eq. It increases as 
nifi increases. Since leptons have a negative hypercharge, 
the contribution to S parameter from leptons can be re- 
duced if rrir' > m^' for appropriate quark masses. 

The interplay of the contributions to AS* from the 
fourth-generation leptons and from the Higgs is also re- 
sponsible for the asymmetry in the allowed region about 
\Ae\ = in the Ag - ruh plane. The T parameter is 
approximately symmetric with respect to the masses of 
up and down-type fermions when the mass difference of 
fermions is small compared to their masses, as can be 
seen from Eq. Q. But for large rrih, minimizing the lep- 
tonic contributions to S parameter becomes important 
for consistency. This causes the allowed regions to prefer 
A^ < compared to Af > 0, even though the T param- 
eter tends to produce symmetric allowed regions. 

In contrast to leptons, for quarks, the T parameter be- 
comes important in constraining |Aq|, as the hyperchage 
of quarks is positive. This makes allowed regions sym- 
metric about Ag = 0. 



C. Constraints on (Aq, A^) and the effect of 634 

The left panel of Fig. |4] shows the allowed parameter 
space in the Ag - A^ plane for ^34 = 0, for different 
TO/j values. It can be easily seen that with increasing 
TO/j, the allowed difference nir' — rn^i increases. This is 



consistent with the arguments in Sec. IIIB that used the 
contribution to A^* from fermions and Higgs. Also, when 
the lepton splitting |A^| is small, the quark splitting \Aq\ 
has to be large to compensate for the Higgs contribution 



to AT, as argued earlier in Sec. HI A Indeed at large 
enough rrih values, the allowed region is outside the cen- 
tral square and hence always corresponds to \ Aq\ > Mw 
or |A^| > mwi implying that the VF-emission channel is 
necessarily active. Therefore, in case further direct con- 
straints increase the lower bound on ruh to be > 900 GeV, 
the W^-emission signal is not observed in either quark or 
lepton channel, and ^34 is restricted by independent ex- 
periments to be very small (say smOj,^ < 0.05), then the 
model with four generations can be ruled out at 95% 
confidence level. 

The scenario when the mixing angle ^34 is significant is 
shown in the right panel of Fig. [4j where the value of ^34 
corresponds to the current upper bound on it. It can be 
seen that in such a case, |Ag| > Mw is forbidden, while 
jA^I > mw is allowed. 

Our results are consistent with those obtained earlier 
in In addition, we have shown the pattern of al- 

lowed mass differences of fermions as a function of rrih 
and quark mixing. 



IV. COLLIDER IMPLICATIONS 

According to our results, to^/ > to^/ -|- Mw may be 
allowed for large rrih values. In that case, the branch- 
ing ratio BR(t' -> h'W) will depend on sin 6*34. Such a 
scenario was considered in [15j to generalize the direct 
search experiment limits on toc and to;,' to include the 
effect of mixing of fourth-generation quarks to the three 
existing generations. In our case, we have zero mixing 
between fourth-generation quarks and the first two gen- 
erations in contrast to the assumption of |15j . But it 
does not affect the BR(t' h'W) [although the decays 
t' — ^ qW {q = d, s) will be forbidden] as long as the 
b-quark mass can be neglected. Therefore our use of 
the results of [TO for the model-independent bounds on 
the quark masses is still justified. The consideration of 
TOf > mb> + Mw scenario by [15] was motivated by the 
result of [55] which stated that in a two-Higgs doublet 
model with a fourth generation, — to;,/ can be greater 
than Mw and also be consistent with precision EW data. 
Reference [82] also shows that mt'—mb' > Mw is possible 
with one Higgs doublet of SM4 when m^./ — m^> < Mw- 
However, it assumes no 3-4 mixing in the quark sec- 
tor. Similar conclusions hold also for the mass difference 
TOf,' — TOt/, which may be greater than Mw, leading to 
the possibility of the decay channel b' — >■ t'W. 

We have shown that \mt' — mi,' \ > Mw is allowed even 
after marginalizing over the lepton masses and ^34. Our 
result, in addition to the result of [82], justifies consider- 
ing I TOf — TOb'l > Mw for interpreting direct search data 
on fourth generation quarks, as was done in |15j . Our re- 
sult also means that the conditions \mti — m^i \ > Mw can 
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(GeV) (GeV) 

FIG. 3: The 95% C.L. allowed regions in the - plane. In the top two panels, is varied over \Aq\ < 200 
GeV, while in the bottom two panels Ag is restricted to be less than Mw- In the left two panels, 634 is varied over 
sin^34 < 0.3, while in the right two panels, 634 has been fixed to zero (no mixing). The parameters rriq and nii are 
varied over their complete allowed range. The grey shaded region is excluded at 95% by the LHC data. The dashed 

blue lines correspond to |A^| = m^. 




FIG. 4: The 95 % C.L contours in the A, - Ae plane, for mi, = 400 GeV (black dotted lines), uih = 600 GeV (red 

dashed lines) and nih — 800 GeV (blue/solid), respectively. The left (right) panel shows the results when 
sin034 = 0.0(0.3). All the other parameters are varied over their 2a allowed ranges. The vertical blue dashed lines 
correspond to jA^j = Mw, while the horizontal green (dotted) lines correspond to jA^j = Mw- 
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FIG. 5: Shaded region in the left (right) panel indicates the values of the branching ratios of t' — > b'W [b' — ^ t'W) 
allowed at 95% C.L. by all the constraints considered in this paper. 
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FIG. 6: Allowed values of toc — m;,' (shaded region) for 
rrih = 600 GeV as a function of sin 6134 after 
marginalizing over the other NP parameters 



be met even in the case of one Higgs doublet. In FigjS] 
we plot the allowed values of branching ratios of the de- 
cays t' — )• h'W and h' — >■ t'W as functions of sin034. One 
can easily see that the branching ratio of the decay of 
a fourth-generation quark into another fourth-generation 
quark can be close 100%. This emphasizes the need to 
consider these decay modes in direct search experiments 
which search for fourth-generation quarks. 

Figure [S] shows that for sin 6*34 > 0.15 there exists 
no point in the parameter space which passes all the 
constraints (direct search, S*, T, U) for which the decay 
(6' — >■ t'W or t' — >■ b'W) is possible. This can be under- 
stood from Fig.|6j where we show the allowed values of A, 
as a function of ^34. For large ^34 values, sin034 > 0.15, 
the mass splitting goes below and the W-emission 
channel is forbidden. 



V. SUMMARY AND OUTLOOK 

We have explored the allowed mass spectra of fourth- 
generation fermions, calculating the constraints from di- 
rect searches at the colliders, the theoretical requirement 
of perturbative unitarity, and electroweak precision mea- 
surements. We take into account the masses of fourth- 
generation quarks as well as leptons, and possible mixing 
of the fourth-generation quarks with the third generation 
ones. The other mixings of the fourth-generation quarks 
and leptons are more tightly constrained, and hence ne- 
glected. 

Our perturbative unitarity calculation with the inclu- 
sion of all the J = channels for 2 — )• 2 fermion scattering 
tightens the earlier upper bounds on fourth-generation 
quark masses by about 6%, while keeping the constraints 
on the fourth-generation lepton masses unaffected. These 
bounds are relatively insensitive to the precision elec- 
troweak observables S, T, U . The mixing between the 
third and fourth-generation quarks is constrained primar- 
ily by the flavor-physics data, to sin034 < 0.3. The per- 
turbative unitarity bounds depend only weakly on this 
mixing. 

Performing a x^-fit to the measured values of the 
precision electroweak parameters 5', T, U , we find that 
large values of the Higgs mass, nih ^ 600 GeV as in- 
dicated by the current LHC data, allow the mass split- 
ting between the fourth-generation quarks or leptons to 
be greater than M^f. In the case of the quark splitting 
Ag = rrit' — mb', the possibility \Aq\ > Mw starts being 
allowed at 95% C.L. for ruh > 200 GeV. For the lepton 
splitting Ai = m^i — m-Ti, the possibility A^ > Mw is 
allowed at 95% for mu < 450 GeV, while A^ < -Mw 
is allowed for all values of mh. Moreover, if 6*34 is small, 
either |Ag| > Mw or jA^j > Mw is necessary for values 
of TO/i as large as 800 GeV. We present correlations be- 
tween the values of A^ and A^, as well as the constraints 
on them as functions of rrih and ^34. 
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Most of the above observations may be explained qual- 
itatively through the analytic expressions for the con- 
tribution to the S and T parameters by the Higgs and 
the fourth-generation fermions, and their interference. In 
particular, the requirement of |Aq| > Mw or jA^I > Mw 
at large rrih for small 634, and the relaxation of this for 
large 634, can be easily motivated. These expressions 
also allow an understanding of the asymmetric bounds 
on ibAf, and why m^/ > 'rn,j> is necessary at large m/j. 
No such hierarchy of masses can be predicted in the quark 
sector. 

The unique feature of our analysis are the simultane- 
ous consideration of the lepton masses, the quark mixing, 
and the recent indication of the heavy Higgs. The ma- 
jor consequence of our result is the opening up of the 
W-emission channels t' ^ b'W, b' ^ t'W, ot: t' ^ v'W 
for large values of m,h. This will have major implica- 
tions for the direct collider searches for fourth-generation 
fermions which currently are performed assuming for ex- 
ample, t' bW/b' tW as the dominant decay modes. 
Indeed, since the branching ratios of these decay modes, 
when kinematically allowed, are large, they can have im- 
pact on the currently stated exclusion bounds, which 
have been arrived at by assuming that these decays are 
not allowed. In order to get model-independent bounds 
on the masses of the fourth- generation fermions, it is nec- 
essary to analyze the data keeping open the possibility 
of large branching ratios in the T'F-emission channels. 

We also find in our analysis, that in case further direct 
constraints increase the lower bound on rrih to be > 900 
GeV, the T4^-emission signal is not observed in either 
quark or lepton channel, and 634 is restricted by indepen- 
dent experiments to be very small (say sin ^34 < 0.05), 
then the model with four generations can be ruled out at 
95% confidence level. 

In conclusion, the fourth generation is currently alive 
and well. However if the corresponding standard model 
Higgs is heavy, it presents the possibility of an early di- 
rect detection of the fourth-generation fermions and also 
affects the search strategies as well as possible exclusions 
of the fourth-generation scenario strongly. Either way 
will lead to an important step ahead in our understand- 
ing of the fundamental particles. 
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of the heavy quarks of the SM4. Unitarity of the S- 
matrix and the validity of perturbativc expansion of the 
S-matrix at high ccnter-of-mass energies constrain the 
behavior of scattering amplitudes at high center-of-mass 
energies. For example, in the case of 2 — >• 2 scattering 
of scalars, the tree-level amplitude is restricted to less 
than unity, \Mq\ < 1. If the scattering particles have 
other quantum numbers, the tree- level amplitudes form 
a matrix in the space of the quantum numbers. The 
analogous criterion for the perturbative unitarity of the 
S-matrix will be that the absolute value of the maximum 
eigenvalue of the matrix- valued amplitude should be less 
than unity. 

In the case of SM4, the J = partial-wave ampli- 
tude of 2 — > 2 fermion scattering receives contribution 
from processes of the type FF — >• F'F' where F and 
F' are two heavy fermions of the SM4. The scattering 
amplitudes depend on the helicity configurations of the 
initial and final state fermions. Since the couplings of 
fermions to bosons in the SM arc of scalar, vector or 
axial-vector type, the number of helicity configurations 
at high center-of-mass energies which have nonvanishing 
J = amplitudes reduces to four: {-I— I — > ++}, {+H — > 

},{ > ++},{ > }• The 2 2 scattering 

amplitude of quarks is a matrix with both helicity and 
color indices. We consider only the amplitudes where 
the initial and final states are color-neutral and charge- 
neutral. 

Let t, t', b' be denoted by the indices « = 1, 2, 3. respec- 
tively, and let rrii be their masses. In the limit where 
the center-of-mass energy of the scattering s » rriimj, 
the tree-level amplitudes for the processes FF F'F' 
may be written in the form of a 30 x 30 matrix M. This 
matrix may be conveniently represented in the basis 
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where R, G, B represent the three colors. In this basis. 



M = 



ABB 
BAB 
B B A 



(Al) 



Appendix A: Partial-wave amplitudes 

In this appendix, we give the expressions for the J = 
partial-wave amplitudes of 2 ^ 2 scattering processes 



Where A, B are 10 x 10 matrices which describe the scat- 
tering amplitudes. Taking the mixing between the third 
and fourth-generations into account, the matrices A and 
B may be written as 
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is obtained from A + 2B [71] , which is given by 
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where = 1 - il/3)\Vtb'\^ Sy ^ 1 - il/'S)\Vt,b'\^ 5, - {l/i)Vtb-V*,, and = {l/i)V;,.Vt.b- 



Note that the presence of a nonzero mixing between the 
third and fourth-generation quarks is responsible for the 
appearance of the channels tt' — > b'h' and t't — > 6'6'. These 



channels are directly proportional to the mixing matrix 
elements in contrast to other channels where the effect of 
mixing matrix elements is not significant. 
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